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Abstract 


This work concentrates on fitting and tracking of 2-D and 3-D images 
using a deformation model. The deformation model uses wavelets and also 
utilizes the interrelation between wavelets and function spaces (in this case 
Sobolev space) in order to impart a certain degree of smoothness to the fitted 
curves. The formulation defines a probabilistic model that induces a prior 
distribution for contour deformation. To increase the robustness of the 
approach, the wavelet models are expressed in terms of shape spaces. Based 
on this distribution, the fitting problem is solved in Bayesian terms. Several 
examples illustrating the success of the model in both 2-D and 3-D have 
been included. Also the same framework has been used for the tracking 
purpose. The deformation model is used to generate a prior dynamic model 
for contour evolution in time. This probabilistic model is then applied to 
solve the tracking problem. The tracking problems for both the 2-D and the 
3-D cases have been solved using the Kalman filter. 
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Chapter 1 


Introduction 


Boundary representation is very important in shape description and recognition [1]. 
It plays a key role in many applications such as image analysis, pattern recognition, 
computer graphics and computer-aided animation. In many cases, such as in medical 
images, finding the boundary of structures, segmenting and reconstructing a compact 
geometric representation of these structures is difficult due to the huge number of 
data sets and the complexity and variability of the shapes of interest. Furthermore, 
the shortcomings of sampled data, such as sampling artifacts, spatial aliasing and 
noise, may cause the boundaries of structures to be indistinct and disconnected. Tra- 
ditional boundary finding techniques which consider only local information usually 
do not give satisfactory results as the edges that are found do not necessarily corre- 
spond to the boundaries of the objects. With the exception of high-quality images 
from controlled environments, they produce spurious edges and gaps and so they are 
of limited use in general and of no use in poor quality images. As a result, these 
model-free techniques usually require considerable amounts of expert intervention. 

Among model-based techniques, deformable models offer a unique and powerful 
approach to image analysis. Deformable models are object models that possess shape 
varying capability, which makes them suitable for representing non-rigid objects. 
They have been found to be effective in segmenting, matching and tracking different 
structures by exploiting constraints derived from the image data together with the 
a priori knowledge about the location, size and shape of these structures. Apart 


5 



from computer vision and computer graphics, they have found wide application in 
medical image analysis. Among other applications, 2-dimensional and 3-dimensional 
deformable models have been used to fit and track a variety of structures widely 
ranging in scale and variety. For example, they are used to fit and subsequently 
track the non-rigid motion of the heart. 

Deformable model geometry usually permits broad shape coverage by employing 
geometric representation that involve many degrees of freedom. The model remains 
manageable, however, because the degrees of freedom are generally not permitted 
to evolve independently. Usually deformations are confined in a region of the whole 
space and prior information about preferred deformations of the model can be ob- 
tained. This preference is then expressed in terms of a deformation energy (or cost) 
that penalizes some deformations. The importance of this prior information is that it 
simplifies and increases the robustness of the solutions to some problems like fitting 
and tracking. The deformation energy is coupled with a data mismatch criterion that 
measures the degree of discrepancy between the model and some measures extracted 
from an image. Model matching can then be formulated as an optimization problem 
of a combined criterion function that is defined in terms of both the deformation and 
the mismatch energy. 

An important subset of deformable models is the set of active contour models 
where an object is characterized by its external shape. Some commonly used de- 
formable models are discussed in the following section. 

1.1 Some Previously used methods 

1.1.1 Snakes 

Snakes [2] are planar deformable contours that are often used to approximate loca- 
tions and shapes of object boundaries in images based on the reasonable assumption 
that boundaries are piecewise continuous or smooth. Geometrically, a snake is a 
parametric contour embedded in the image plane. The shape of the contour is dic- 
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tated by a functional which represents the energy of the contour and the final shape 
of the contoui coiiesponds to the minimum of this energy. The functional consists 
of t,wo terms. Ihe first term represents the internal deformation energy which char- 
acter izes the deformation of a stretchy, flexible contour. The two physical parameter 
functions that dictate the physical characteristic of the contour are the tension of 
the contour arrd the rigidity. The second term couples the snake to the image. It is 
a scalar potential defined on the image plane. 

1.1.2 B-spline 

Another way to represent image contours is to use piecewise polynomials. This 
representation is compact, local (i.e. a small change in the original curve does not 
effect the entire representation) and also it allows continuous approximation, even 
over gaps in the data. The approach commonly used consists of first extracting a 
set of knots from the discrete curve and then approximating the elementary curves 
between each pair of knots by a B-spline [3]. A B-spline is a piecewise polynomial, 
which is expressed as a linear combination of basis functions, which are themselves 
piecewise polynomials where the coefficients are the vertices of the B-spline guiding 
polygon. They can be manipulated by modifying its guiding polygon and as they are 
defined locally, modifying the position of a vertex only affects the B-spline locally. 

1.1.3 Fourier Descriptors 

In some research work [4], Fourier descriptors have been used to represent contours 
that are smooth and continuously deformable. The parameters of the deformable 
contours are the Fourier coefficients. A probability distribution on the Fourier co- 
efficients is specified so that there is a flexible bias towards some particular shape. 
The spread of the distribution is governed by the variability of the object class. A 
Bayesian decision rule is then used to obtain the optimal fitting of the boundary to 
the image. 
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1-2 Our Methodology 


Foi this thesis, the relation between wavelets and smoothness spaces (namely Sobolev 
Space) have been used to build wavelet contour representations [5] with a desired 
degiee of smoothness. Wavelet descriptors are very efficient in representing and 
detecting local features of a curve due to spatial and frequency localization property 
of wavelet bases. For this type of representation, different levels of smoothness 
can be defined and smooth deformations can be enforced without the necessity to 
alter the balance between the uncertainty of the prior model for deformations and 
data extracted from the image. This wavelet representation is set in probabilistic 
terms so tiiat the realizations of the stochastic model are almost sure in a predefined 
smoothness space. To increase the robustness of the approach, the wavelet models 
are expressed in terms of shape spaces. Then Bayesian estimation has been used to 
find the optimum fitted contour. 

To solve the tracking problem, Kalman filter has been used. The tracking problem 
is a two-phase problem in which a dynamic model taken as an autoregressive process 
is used for prediction from one time step to the next. Then the predicted contour 
is refined using the measures obtained from the image and these two phases are 
repeated again with the next frame from the sequence. Both the fitting and tracking 
problem has been implemented successfully in both 2-dimensions and 3-dimensions. 

1.3 Organization of the thesis 

In Chapter 2 of the thesis, some background material is provided which includes some 
portions of wavelet transform and their salient features, Sobolev Space, inter-relation 
between Sobolev Space and wavelet transform coefficients, Bayesian estimation and 
Shape space. The theory of curve fitting in 2-dimensions has been discussed in details 
in Chapter 3. Chapter 4 of the thesis deals with Kalman filter theory which has been 
used for tracking in both 2-D and 3-D and also the dynamical model which has been 
considered. The theory of surface fitting and tracking in 3-D is covered in Chapter 
5. Implementation algorithms for fitting and tracking for both 2-D and 3-D cases 
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are given in Chapter 6 along with the implementation results for both cases. The 
thesis ends with the conclusion and scope for future research in Chapter 7. 
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Chapter 2 


Background on Wavelets, Sobolev 
Space, Bayesian Estimation and 
Shape Space 

2.1 Introduction 

In this chapter, some background material is presented which will be required for 
the understanding of the thesis. First, a brief overview of the wavelet theory [6] [7] [8] 
and some salient features of wavelet transform are given. The theory of Sobolev 
space [5] [9], basics of Bayesian estimation [10] and Shape space [5] [11] [12] are then 
discussed. 

2.2 Wavelet Theory 

Multiresolution theory is concerned with the representation and analysis of signals 
or images at more than one resolution. So features which might go undetected at 
one resolution may be easy to spot at another. In multiresolution analysis (MRA), 
a scaling function is used to create a series of approximations of a function or im- 
age. Additional functions, called wavelets are then used to encode the difference in 
information between adjacent approximations. 


10 



A function f(x) can be expiessed as a linear combination of expansion functions 

f{x) = Y^ak(pk{x) ( 2 . 1 ) 

k 

wheie A, is an integer index of the finite or infinite sum, ak are real valued expansion 
coejficicnts and are real valued expansion functions. 

Considei the expansion functions are composed of integer translations and binary 
scalings of the real square- integrable function ip{x) i.e. the set {v3yfe(x-)}) where 

Vpk{x) = - k) ( 2 . 2 ) 

for all j, A: € Z and <p{x) e I/^(R). Here k determines the position of ^j,k{x) along the 
•x-axis, j determines its width and 2 ^/^ controls its amplitude. Because the shape of 
Vj,k{x) changes with j, <p{x) is called a scaling function. By choosing (p{x) properly, 
can be made to span L^(R), the set of all measurable, square-integrable 

functions. 

The subspace spanned over k for any j is denoted as 

Vj = Spanfc{(pj-,fc(x)} (2.3) 

The scaling function obeys the four fundamental requirements of MRA. 

• The scaling function is orthogonal to its integer translates. 

• The subspaces spanned by the scaling function at low scales are nested within 
those spanned at higher scales. 

l/_oo c • • ■ C F-i C l/o c C • • ■ C l/oo ( 2 . 4 ) 

• The only function that is common to all Vj is f{x) — 0 

• Any function can be represented with arbitrary precision. 

Given a scaling function, we can define a wavelet function ip{x), that together 
witli its integer translates and binary scalings, spans the difference between any two 
adjacent scaling subspaces. It is defined as ■ 

■4,j4x) = 2^/^ij{2^x-k) \/kez ( 2 . 5 ) 
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The subspace spanned over k for any j is denoted as 


Wj = Spanfc{i/-j-fc(a:)} (2.6) 

The scaling and wavelet function subspaces are related by 

V,-+i = 1^- © W,- (2.7) 

where © denotes the union of spaces. 

The space of all measurable, square-integrable functions can now be expressed as 

= ( 2 . 8 ) 

2.2.1 Wavelet Series Expansion 

The wavelet series expansion of a function f{x) € T^(R) is given by 

00 

/(^) = S (2.9) 

I j=jo I 

where jo is an arbitrary starting scale. The Cj^^i are called approximation or scaling 
coefficients and dj^i are called detail or wavelet coefficients. If the expansion functions 
form an orthonormal basis then the expansion coefficients can be calculated as 

<Pjo,ii^)) = j ( 2 - 10 ) 

and 

dj,i = (/(a;),'0j,j(a^)) = j (2-11) 

2.2.2 Salient Features of Wavelet Transform 

There are a number of salient features in wavelet transforms that make wavelet- 
domain processing attractive. 

• Locality: Each wavelet coefficient represents the signal content localized in 
spatial location and frequency. 

• Multiresolution: The wavelet transform analyses the signal at a nested set of 
scales with different resolutions. 
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• Energy compaction: A wavelet coefficient is large only if singularities are 
present within the support of the wavelet basis. Therefore in contrast with 
other approaches, we need to model only a small number of coefficients. This 
is of great importance in real-time apphcations. 


2.3 Wavelet Basis Functions 


Some commonly used wavelet basis functions are Haar wavelet, Shannon wavelet, 
Daubechies wavelet, Biorthogonal wavelet, Butterworth wavelet, etc. For this thesis, 
Haar basis function has been used. 

Haar Basis Function The Haar scaling function is defined as 


<p(/,) = { 


1 

0 


for 0 < t < 1 
otherwise 


and Haar wavelet is given by 


^{t) = < 


1 

-1 

0 


for 0 < t < I 
for I < t < 1 
otherwise 


1 


0 (a) 1 t 



Figure 2.1: (a) Haar scaling function, (b) Haar wavelet function 
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2.4 Sobolev Space 


A function space is a vector space whose points are functions. Sobolev Space is one 
type of function space. The space LP is the set of measurable functions / which are 
p-integrable. A function / (x) is said to be p-integrable if 

/ OO 

i f{x)\^dx (2.12) 

•OO 

is finite. 

The Sobolev space for 1 < p < oo and s = 1, 2, 3, . . . is defined 

to be the space of all functions / € D’{R) such that, for all n = 1, 2, . . . , s, the 
derivative of / also belongs to iA(R). The following quantity is the norm on the 
space LP'^. 

ll/llL...=ll/lli, + El|i)“/llj> (2.13) 

n=l 

where D"/ is the derivative of the function /. 

The Sobolev norm of a function is related to its smoothness. Again, this norm 
can be expressed in terms of the scaling and wavelet coefficients of the function. Thus 
the smoothness of the function is related to its scaling and wavelet coefficients. A 
curve belongs to the Sobolev space if its co-ordinate functions belong to that space. 
Like in the case of functions, for curves also the smoothness of the contour is related 
to the coefficients of its representation by means of the contour norm in Sobolev 
space. 


2.5 Bayesian Estimation 

Suppose that the distribution of a RV (random variable) x is a function F{x,0) of 
known form depending on a parameter 6 and we wish to estimate 0. To do so, the 
underlying physical experiment is repeated n times and the observed values of x are 
denoted by Xj. It 9 is viewed as an unknown constant and the estimate is solely based 
on the observed values Xj of the RV x, then it is called classical estimation. But in 
certain applications, ^ is not totally unknown. In bayesian statistics, the available 
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prior information about 9 is used in the estimation problem. In this approach, the 
unknown parameter 9 is viewed as the value of an RV 6 and the distribution of x 
is interpreted as the conditional distribution Fa:{x | ^) of x assuming 9 = 9. The 
prior information is used to assign a density fe(9) to the RV 9, and the problem is 
to estimate the value 9 in terms of the observed values Xi of x and the density of 9. 

To solve a bayesian estimation problem, we first assume that no observations are 
available. The available information is the prior density fe{9) of 9 and the problem 
now is to find a constant 9 close in some sense to the unknown 9. If LMS criterion 
is used for selecting 9, then 




9fe{9)d9 


(2.14) 


Now if the observations from the experiments are incorporated, and the same crite- 
rion is used for estimation 



E{9 I X} 


i: 


9fg{9 I X)d9 


where X = [.xi, . . . , ,x„] and 


(2.15) 


fe{0 I X) = /ffl^/,(^) (2.16) 

Here / {X \ 9) is the conditional density of the n RV Xj assuming 9 = 9. The density 
fg{9) is called prior (prior to the measurements), the density fe{9 \ X) is called 
posterior (after the measurements) and the density f{X | 9) is called the likelihood 
function. 


2.6 Shape Space 

Let r(ii) = {x{u),y(u)) be a parameterized closed planar curve that represents the 
shape of our object of interest. The parameterization in terms of B-splines or wavelet 
coefficients can be expressed as 

r,, = (G(u) G(u) V!') 0 < u < L (2.17) 
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where 0(1^) is the vector of B-spline or wavelet basis functions, w® and are 
vectors of B-spline control point coordinates or scaling and wavelet coefficients and L 
is the span of the parameter u. The B-spline control points or the wavelet coefficients 
can be combined in a spline vector or a wavelet vector as 


w = 



(2.18) 


In certain applications, it is necessary to reduce the number of degrees of freedom in 
the model describing the shape of the deformable object. For example, taking w to 
be a spline-vector, from Figure 2.2 it is clear that if all the possible degrees of freedom 
of the spline- vector are manipulated arbitrarily, then many uninteresting shapes are 
generated which are not at all reminiscent of faces. Restricting the displacements of 
control points is more meaningful as it preserves the face-like quality of the shape. 
Shape space is a parameterization of the set of allowed deformations of a base curve. 



Figure 2.2; Control points undergoing arbitrary deformation 

A linear shape space M. — C{H, w) is a hnear mapping of a shape space vector 
X € to the vector w € ; 


w = iJx + w (2.19) 

where H is a. Nw x Nx shape matrix. The vector w represents a hose or template 
curve against which shape variations are measured. For instance, a class of shapes 
consisting of w and curves close to w could be expressed by restricting the shape 
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space M. to small x. There can be several types of shape spaces some of which are 
explained below. 

1. Planar Affine Shape Space : For a planar shape, just six affine degrees of 
freedom are required to describe to a good approximation, the possible shapes 
of its bounding curve. The six possible deformations are illustrated in Figure 
2.3. The planar affine group can be viewed as a class of all linear transforma- 
tions that can be applied to a template curve ro(ri): 

r(u) = t + Mto{u) (2.20) 

where t = (ti,t 2 )^ is a two-dimensional translational vector and i\^ is a 2 x 
2 matrix, so that t and M together represent the 6 degrees of freedom of the 
space. This class can be represented as a shape space with template w and 
shape matrix 

/ T 0 0 0 ■wy\ 

iJ = (2.21) 

y 0 T 0 wJ' w=" 0 J 

where T = (11 . . . 1)^ or T = (10 . . . 0)^ depending upon whether B-splines 
or wavelets have been used and 0 = (00 . . . 0)^ are vectors each with N com- 
ponents where N is the dimension of w® or w^. The first two columns of H 
represent horizontal and vertical translation. The remaining four affine mo- 
tions do not correspond one-for-one to the last four colmnns of H. But they 
can be expressed as linear combinations of these columns. Prom the shape 
space transformation in equation (2.19), it is clear that the elements of x act 
as weights on the columns of H. The interpretation of those weights in terms 
of planar transformations of the template is; 

X = Mil ~ Ij M 22 — 1, M 21 , Mi2)^ (2.22) 

Some examples of trmisformations are: 
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• X = (0, 0, 0, 0, 0, 0)^ represents the original template shape w 

• X = (1, 0, 0, 0, 0, 0)^ represents the template translated 1 unit to the right 

• X = (0, 0, 1, 1, 0, 0)^ represents the template doubled in size 

• X = (0, 0, COS0 — l,cos0 — 1, — sin0, sin^)^ represents the template ro- 
tated through angle 9 

• X = (0, 0, 1, 0, 0, 0)^ represents the template doubled in width 



Figure 2.3: Six degrees of freedom of 2D affine transformation: translation vertically 
and horizontally, rotation and scaling vertically, horizontally and diagonally 

2. Euclidean similarity shape space: The similarity space for a template curve 
ro (s) with parameter vector w form a four-dimensional shape space with shape 
matrix 

/ T 0 -wy \ 

= (2.23) 

\ 0 T wJ' / 

The first 2 columns are associated with translations while the rest are associated 
with dilation and rotation. 

With this definition for the shape matrix, the shape space vector 

X = {ti,t 2 , k{cos{6) — 1), k(sm{9))) (2.24) 
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translates the curve determined by w ti units on the .r-axis and t 2 units on the 
y-axis, obtaining also a rotation with angle 6 and a scaling with factor k. 

Apart from these there are some other shape spaces like Key Frames Shape 
Space[5]. 
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Chapter 3 


Curve Fitting in 2-diniensions 

3.1 Introduction 

This chapter deals with the theory of curve fitting in 2-dimensions [5]. First, the 
representation of curves in terms of its wavelet coefficients is given. Then a prob- 
abilistic model of the curve is formulated which is followed by the formulation of 
wavelet based deformation model in shape space. Finally, the fitting problem is 
solved using Bayesian estimation. 

3.2 Wavelet Shape Representation 

Let r((/.) = (.■r(n), 2 /(u)) be a parameterized closed planar curve that represents the 
shape of an object of interest. If the wavelet transform is applied independently to 
each of the x{u), y{u) functions, we can describe the planar curve in terms of the 
decomposition of r(u) : 

OO 

v{u) — jo, jo , ^ ^ djj'ipjjiju) (3-1) 

l j-jo i 

where 

^jo,i ~ ^joMy)) 

djj = idjj(x)jdjj(^yj) 
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(3.2) 

(3.3) 



Here jo is an arbitrary starting scale. The Cjgd{x) and dj,/(x) are the scaling coefficients 
and wavelet coefficients for the function x{u) and and djd(y) are the scaling 

coefficients and wavelet coefficients for the function y(u). and dj^ are the com- 
bined scaling coefficients and wavelet coefficients for the curve r(u). The parameter 
is denoted by u and T denotes the transpose operator. 

If the curve r(u) is closed and the parameter u belongs to an interval / = [0, L], 
then we obtain the representation : 

OO 

r(u) = Co,ov 2 o.o(^) + djdi’j,i{u) (3.4) 

J=0 0<l<2i 

Here the starting scale is taken as 0. The coefficients in the cui've expansion is defined 
as : 

Co,o = {{x{u),(pofl(u)), (y(u), ^o,o('a)))^ (3.5) 

djd = {{x{u), i’jdiu)), (y(u), (3.6) 

Here (, ) denotes the scalar product : 

= f{u)g{u)du (3.7) 

The scaling and wavelet functions are normalized so that: 

II ¥’o,o||l 2(7) =11 ^i,/ilL2(/) = 1 II ffL2ii) = (/’ /) (3-8) 


In practice, only a finite number of coefficients are considered. So the represen- 
tation becomes : 

j 

r(u) = co,o!/?o,o(w) +X) X) (3-9) 

i=0 Q<1<20 

Ciu've expansion can be written in concise form. First the scaling and wavelet 
functions are expressed in vector form as : 

Gm/(u) = (¥’o,o(w), V'o,o(^i), • ■ • , '0J-l,2-'-i-l(«))^ (3.10) 


then the coordinate functions can be written as ; 

x{u) — Gw{u)^'W^ and y{u) = GH/-(n)^w-^ (3.11) 
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with scaling and wavelet coefficient vectors and defined as ; 


— (<^ 0 , 0 (a:), <^ 0 , 0 ( 2 ), • 


(3.12) 

(^' 0 , 0 (j/) j ^ 0 , 0 ( 3 /) ) - 


(3.13) 


To describe the curve in matrix form, we define : 




(3.14) 


Fw{u) = h ® 

O^jv Giv(u)'' 

where ® denotes Kronecker product and O^r a null vector of N components where 
N = 2^. 

sT 


If we define w = (w®^, , then we may write 

r(u) = Fw(u)w 


(3.15) 


3.3 Wavelet Probabilistic Deformation Model In 
Sobolev Spaces 

The contour fitting and tracking problem can be formulated in probabilistic terms 
that allow an explicit representation for the uncertainty. The simplest wavelet trans- 
form statistical models are obtained by assuming that the coefficients are indepen- 
dent. Under the independence assumption, modeling reduces to simply specifying 
the marginal distribution of each scaling and wavelet coefficients. Here Gaussian 
distribution is employed. It can be shown that the Gaussian distribution is related 
to Sobolev spaces by means of the following result : 


Theorem 3.3.1 Let f{x) be a real function where x is a real variable. Let it be 
decomposed in wavelet coefficients and suppose each coefficient is independently and 
identically distributed as 

dj,k ^ aj = 2~^^aDEF (3.16) 

with /? > 0 and aoEF > 0. Then the realizations of the probabilistic model are almost 
surely in the Sobolev space if and only if P > s + 1/2. 
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This result is extended to contours by the following theorem: 

Theorem 3.3.2 Let a curve C = r(u) = {x{u),y{u)) be decomposed on its wavelet 
representation and suppose that the vectors of its representation dj k are indepen- 
dently and identically distributed as : 

^j,k = {dj,k{x), ~ •^(02, cr^jl2) (3-17) 

Cj — 2 /3 > 0 and ctdef > 0 (3.18) 

then the realizations of the model are almost surely in the curve extension of the 
Sobolev space if and only if P > s 1/2. 

This result shows that the exponential decay of the variances aj = 2 ~^^(Jq can 
be used to enforce the smoothness of the contours generated from the probabilistic 
model. The greater the value of p, smaller is the variance and so the contours 
generated are smoother. 

To complete the definition of the probabilistic model, the distribution of the 
scaling coefficient co,o is to be specified.. This coefficient is associated with the trans- 
lation of shape and it is assumed to be normally distributed and independent of the 
non-translation components dj,*. 



23 



Here (3 is related to the smoothness of the deformation and a^xR and ct^def are 
related to the uncertainty of the contour. 

3.4 Wavelet Based Deformation Model In Shape 
Spaces 

Shape Space has been discussed in details in Chapter 1. It is a parameterization of 
the set of allowed deformations of a base curve. A linear shape apace M. = C{H, w) 
is a linear mapping of a shape space vector x G to the vector w € : 

w = i?x + w (3.22) 

where H is a Nw x Nx shape matrix. The vector w represents a base or template 
curve against which shape variations are measured. Here planar affine shape space 
has been used. 

Planar Affine Shape Space : Here 6 degrees of freedom are allowed. The 
planar affine group can be viewed as a class of all linear transformations that can be 
applied to a template curve ro(w): 

t{u) = t + Mro(«) (3.23) 

where t = (ti, * 2 )^ is a two-dimensional translational vector and M is a 2 x 2 matrix, 
so that t and M together represent the 6 degrees of freedom of the space. This class 
can be represented as a shape space with template w and shape matrix 

/ T 0 w== 0 0 \ 

H = (3.24) 

y 0 T 0 wy 0 J 

where T = (10 . . . 0)^ and 0 = (00 . . . 0)^ are vectors each with N components. The 
shape space vector is given by : 


X = (ti,t2, Mil ~ 1) M 22 ~ 1) M 21 , Mi2)^ (3.25) 
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3.5 Probabilistic Model In Shape Spaces 

The probabilistic model in wavelet space induces a probabilistic model in shape space: 

P(x) oc e.-Ep(-^x^Six) (3.26) 

where is the covariance matrix of the vector x. Since w = ffx + w, so we can 
write 

X = H^(w — w) (3.27) 

where is the pseudo-inverse of . If P is a m x n matrix, then the pseudo-inverse 
is a n X m matrix defined as 

(3.28) 

Here since w is the combined wavelet vector of the base curve, say x, so x = 0. This 
is also evident from the fact that shape space vectors are basically deviations from 
the base or template curve. Then the inverse of the covariance matrix is given 
by: 

(3.29) 

3.6 The Fitting Problem 

For this thesis, Bayesian estimation has been used to find the optimum shape space 
vector of the contour. The fitting problem can be defined in Bayesian terms as 
follows: 

The prior density is given by the probabilistic model in shape space, i.e. 

P(x) oc ea:p(— ix^Sxx) (3.30) 

From the image, some measurements of the contour X£» are obtained. The likelihood 
function is defined as : 

P{td I r) = P(w£) 1 w) = P(x£, 1 x) a e.Tp(-i(x - xj 5 )^Sd(x - xd)) (3.31) 
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with the matrix So given by: 


Si>-' = H+aD^H+^ (3.32) 

Here aj) is the variance of wj) — w where the wavelet and shape spaces are related 
by : 

r£» = Fh/W£) W£) = i?xj3+w (3.33) 

From Bayesian estimation, we get the maximum aposteriori estimate x as: 

X = (S^ + Sx)) ^Sx)Xx) (3.34) 

where the measurement vector X£) is given by xx) = H'^(yvD — w) 
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Chapter 4 


Curve Tracking 

4.1 Introduction 

In this chapter, the theory of Kalman Filter is discussed. Also, the dynamical model 
which has been used in the thesis for tracking problem is given. 

4.2 Theory of Kalman Filter 

A distinctive feature of the Kalman filter [13] [14] is that its mathematical formulation 
is described in terms of state space concepts. Another novel feature of the Kalman 
filter is that its solution is computed recursively, applying without modification to 
stationary as well as nonstationary environments. In particular, each updated esti- 
mate of the state is computed from the previous estimate and the new input data, 
so only the previous estimate requires storage. In addition to eliminating the need 
for storing the entire past observed data, the Kalman filter is computationally more 
efficient than computing the estimate directly from all of those past data at each 
step of the filtering process. 

Consider a linear, discrete time dynamical system described by the signal flow 
graph shoTvn in Figure 4.1. In mathematical terms the signal flow graph embodies 
the following equations. 
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Figxire 4.1: Block Diagram For Kalman Filter Algorithm 


1. Process Equation : 

x(n) = Ax(n — 1) + Bi/i(n — 1) (4.1) 

Here x € Tl^ is the M-dimensional state vector that we are trying to estimate. Ui 
is a M X 1 vector which represents the process noise. It is modeled as a zero mean 
white noise process whose correlation matrix is defined by : 

E[ui{n)ui^ {k)] = 

The process equation models an unknown physical stochastic phenomenon denoted 
by the state x(n) as the output of a linear dynamical system excited by the white 
noise i/i(n — 1). The M x M transition matrix A relates the state at the previous 
time step (n—l) to the state at the current time step n in the absence of any driving 
force or process noise. In practice it might change with each time step, but here it 
is assumed to be constant. 


Qi(n) n = k 
O n ^ k 


(4.2) 


2. Measurement Equation : 

y(n) = Cx(n) + i> 2 {n) (4.3) 

Here y G is the TV-dimensional observation vector. It is actually the set of 
observed data that is used to estimate the vector x. C is a known NxM measurement 
matrix. The TV x 1 vector U 2 is called measurement noise, modeled as a zero mean 
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white noise process whose correlation matrix is : 




Q 2 (rJ') n = k 
O n^k 


(4.4) 


The measurement equation relates the observable output of the system y(n.) to the 
state x(n). 

It is assumed that x(0), the initial value of the state, is uncorrelated with both 
Vi{n) and for n > 0. The noise vectors ^ 1 ( 71 ) and ^' 2 (^) are statistically 

independent, so we may write 


E[vx{n)u 2 ^ {k)] = 0 Vn and k 


(4.5) 


The Kalman filtering problem, namely, the problem of jointly solving the process 
and measurement equations for the unknown state in an optimal manner may be 
formally stated as : 

Using the entire observed data, consisting of the observations y(l), y(2), . . . , yin) 
find for each n > 1 the minimum mean square estimate of the state x(i) . 

The problem is called prediction if z > n. 


4.2.1 Kalman Filter Algorithm 

We define x“(n) E 71^ to be the a priori state estimate at step n given knowledge 
of the process prior to step n and x(n) € to be the a posteriori state estimate 
at step n given observation vector y(n). We can then define a priori estimate error 
as 

e“(n) = x(n) — x'"(?i) (4.6) 

and a posteriori estimate error as 

e(n) = x(n) - x(n) (4.7) 

The a priori estimate error covariance is then 

P“(n) = £;[e-(n)(e-(n))^] (4.8) 
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and the a posteriori estimate error covariance is 


P(n) = £;[e(n)(e(n))^] (4.9) 

In deriving the equations for the Kalman filter, we begin with the goal of finding an 
equation that computes the a posteriori state estimate x(n) as a linear combination 
of the a priori state estimate x~(n) and a weighted difference between the actual 
observation y(n) and the predicted observation Cx~(n) as given : 

x(n) = x~(n) + K(n)(y(n) — Cx“(n)) (4-10) 

The difference (y(n) — Cx~(n)) is called the measurement innovation, or the residual. 
The residual reflects the discrepancy between the predicted observation and the 
actual observation. A residual of zero means that the two axe in complete agreement. 
The M X N matrix K is known as the Kalman Gain. It is chosen such that the a 
posteriori error covariance is minimized. 

The equations of the Kalman filter can be grouped into two groups : time up- 
date equations and measurement update equations. The time update equations are 
responsible for projecting forward (in time) the current state and error covariance 
estimates to obtain the a priori estimates for the next time step. They are also 
known as predictor equations. The measurement update equations are responsible 
for incorporating a new measurement into the a priori estimate to obtain an im- 
proved a posteriori estimate. They are also called corrector equations. 

Discrete Kalman Filter time update equations 

x~(n) = Ax(n — 1) (4-11) 

p-(n) = AP(ra-l)A^-bBQiB^ (4.12) 

Discrete Kalman Filter measurement update equations 

K(n) = P-(n)C^(CP-(n)C^ + Q 2 (n))~^ (4.13) 
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x(ra) = X (n) + K(n)(y(n) - Cx~(n)) 


(4.14) 


P(n) = (I - K(n)C)p-(n) 


(4.15) 


4.3 Dynamical Model 


Dynamical models [5] [11] characterize an object’s behaviour over time. The prior 
model for the fitting problem has to be extended to deal with the problem of tracking 
the curve over a sequence of images. For tracking, it is necessary to provide not 
only a prior for the first frame, but also a prior for possible motions. It must have a 
deterministic part, giving the expected displacement between frames and a stochastic 
part to measure the uncertainty about the predictions of the model. 

The dynamical model used is a second-order autoregressive process given by : 


x(n) = Aix(n — 1) + A 2 x(n — 2) rj- Bi/(n) 


(4.16) 


Here x is the shape space vector, v is the process noise. Matrices Ai and Ai represent 
the deterministic components of the dynamical model and matrix B represent the 
stochastic component of the dynamical model. We define an augmented vector X(n) 
to be : 


X(n) 


x(n) 
x(n — 1) 

So the second order process can be written as ; 


(4.17) 


X(n) = AX(n - 1) + Bu{n) 


(4.18) 


where 



(4.19) 


For this thesis, this augmented model has been used for modeling the process and 
then Kalman Filter algorithm has been used for tracking. 
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Chapter 5 


Fitting and Tracking in 
3-Dimensions 

5.1 Introduction 

Fitting and tracking in 3-dimensional data is required, specially in the case of medical 
imaging like tracking the non-rigid movement of heart from 3-D MRI data. This 
chapter deals with the fitting and tracking of surfaces in 3-D. For analyzing a 3- 
dimensional volume, usually a suitable number of shces are taken depending upon 
the application and also the computational complexity as computation increases 
largely with the increase in the number of shces. So, for fitting in 3-dimensions, we 
have a certain number of slices of the volume. 


5.2 Wavelet Shape Representation in 3-Dimensions 

Let s{u) = {x(u), y(u), z{u)) be the surface that represents the shape of the volume 
which we want to fit. The wavelet transform is apphed independently to each of the 
x{u), y{u) and z{u) functions. Then the surface can be represented in terms of the 
decomposition of s(n) : 

OO 

SE (5-1) 

I 3=30 I 
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where 


^io i^jo (a:) j ^jo.liy) > ( 2 ) ) 

(5.2) 

~ 

(5.3) 


Here jo is an arbitrary starting scale. The Cjf^,i(x) and dj^i(x) axe the scaling coeffi- 
cients and wavelet coefficients for the function x('u), and are the scaling 

coefficients and wavelet coefficients for the function 1/(7/,) and and are 

the scaling coefficients and wavelet coefficients for the function z{u). Cj^j, and djj, 
are the combined scaling coefficients and wavelet coefficients for the surface s{u). 

If the surface is closed, we obtain the representation by taking the starting scale 
as 0 : 

00 

s{u) = co,o¥)o,o(«) + XI (5.4) 

i=0 0<l<2i 

The coefficients in the curve expansion is defined as : 

co,o = (po,o{u)), {y{u), <^o,o(tt)>, {ziu), ¥>o,o(«)))^ (5.5) 

di.J = ((a;(rt), {y{u), {z{u), (5.6) 

Here the scaling and wavelet functions are normalized. Considering only a finite 
number of coefficients, which is usually done in practice, we get the representation 
as : 

J 

s(7i) = Co,o¥’o.o(m) + X X (5-7) 

j=0 0<Z<2J 

This surface expansion can be written in concise form. First the scaling and 
wavelet functions are expressed in vector form as : 

Gw{u) = (^ 0 , 0 (^i), ^ 0 , 0 (w), • • • ,V'j-i.2J-i-i(«))^ (5.8) 

then the coordinate functions can be written as : 

x{u) = Gvf(w)^w® and y{u) = Gw(w)^w^ z{u) = Giv(u)^w'" (5.9) 

with scaling and wavelet coefficient vectors w®, and w* defined as : 

w® = (co,o(i))do,o(i),- ■ • !dj_i,2J^-i_i(i))^ (5.10) 
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(5.11) 

(5.12) 


W*' - (C0,0(y), 4.0(y), - • ■ , dj_i,2J-l_l(y))’’ 

— (C0,0(2), <^ 0 , 0 ( 2 ), • • • , C^J’-1,2'^-1-1(2))^ 

To describe the curve in matrix form, we define : 



^ Gw{uf 

O^jv 

\ 

Yw{u) =13® Gvv(u)^ = 

O^jv 

Gw('ti)^ 

QF N 


\ O^jv 


Gw{u)^ j 


where (gi denotes Kronecker product and Ojv a null vector of N components where 
N = 2^. 

If we define w = (w“^, then we may write 

s(u) = Fiy(M)w (5-14) 


5.3 Wavelet Probabilistic Deformation Model in 
3“Dimensions 

Like in 2-D caise, in 3-D also, the fitting and tracking problem can be formulated 
in probabilistic terms that allow an explicit representation for the uncertainty. For 
formulation of the wavelet probabilistic model, we assume that the coeflScients axe 
independent. Under the independence assumption, modehng reduces to simply speci- 
fying the marginal distribution of each scaling and wavelet coefficients. In this thesis, 
the wavelet coefficients are assumed to be Gaussian distributed. 


(ijjfe(2)) N(0^,cy jTg) (5.15) 

(jj = 2~^^ (7 DEFj > 0 and <7def > 0 (5.16) 

The distribution of the scaling coefficient Co,o is also taken as Gaussian and it is 
taken to be independent of the non-translation components 


co,o 


^ Co, 0(1) ^ 
^0,0(2/) 

\ ^0,0(2) J 




(5.17) 
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Assuming these distributions, the wavelet probabihstic model can be expressed 
in matrix form as 


P(r) = P(w) oc exp(-iw^S^w), r = 


with 


^ 0 


S = S„,-' = la 


0 


0 0 
0 0 ... 


0 

0 

0 


(5.18) 


V 


0 


0 


0 


(5.19) 


Here {3 is related to the smoothness of the deformation and (P'tr and a^oEF are 
related to the uncertainty of the contour. 


5.4 Shape Space for 3-Dimensions 


For surface fitting in the 3-dimensional case, as already mentioned in the previous 
sections, the x, y and z functions are found out from the given shces of the given 
volume and the wavelet transform is applied separately to these three functions. Let 
the combined wavelet vector consisting of the scahng and wavelet coefficients for all 
the 3-dimensions be denoted as w. i.e. 


w = 


/ wA \ 
v/y 

Vw^ / 


(5.20) 


A linear shape apace M = C{H, w) is a linear mapping of a shape space vector 
X € to the vector w e : 


w = Hx-l-w (5.21) 

Here H is known as the shape matrix, w represents a base or template surface 

against which shape variations are measured. 
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In this thesis, the concept of Planar Aflfine Shape in 2-dimensions has been ex- 
tended for the formulation of the shape space matrix and shape space vector for the 
3-D case. Let so(u) be the template surface. This shape space can be viewed as a 
class of all linear transformations that can be applied to so(u) : 

s{u) = t + Mso{u) (5.22) 

where t = (ti, 421 ^ 3 )^ is a three-dimensional translational vector and M is a 3 x 
3 matrix, so that t and M together represent the 12 degrees of freedom of the space. 
This class can be represented as a shape space with template w and shape matrix 


H = 


/too 

0 T 0 
\ 0 0 T 


0 

0 


0 0 0 0 0 0 -wy 

■wy 0 0 0 w® 0 0 

0 wJ/ 0 0 0 0 / 


(5.23) 


where T = (10 . . . 0)^ and 0 = (00 . . . 0)^ are vectors each with N components. 

i 

The first three columns of H represents translations in the 3-dimensions. Linear 
combinations of the other columns represents the remaining motions. 

With this choice of the shape space matrix, the shape space vector is : 


X = (UAo.t^, M^ 


5.5 Probabilistic Model In Shape Spaces 

The probabilistic model in wavelet space induces a probabilistic model in shape space: 

P(x) a e.rp(-^x’’S,,x) (5.25) 

where S^, is the covariance matrix of the vector x. Since w = i?x -1- w, so we can 
write 

■K = H'^ iyv — -w) (5.26) 

where is the pseudo-inverse of H. Here since w is the combined wavelet vector 
of the base surface, say x, so x = 0. This is also evident from the fact that shape 
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space vectors are basically deviations from the base or template surface. Then the 
inverse of the covariance matrix Sj, is given by : 

(5.27) 

5.6 The Fitting Problem in 3-Dimensions 

The fitting problem can be defined in Bayesian terms as follows : 

The prior density is given by the probabilistic model in shape space, i.e. 

P(x) oc ea:p(— ix^Sa;x) (5.28) 

From the image, some measurements of the contour x© are obtained. The likelihood 
function is defined as : 

P(rz> 1 r) = P(wp I w) = P(xx) [ x) a exp(-^(x - xd)^Sd(x - xd)) (5.29) 

with information matrix Sd given by : 

Sd"^ = (5.30) 

Here crn is th® variance of w^) — w where the wavelet and shape spaces are related 
by : 

wd = Hxd + w (5.31) 

Prom Bayesian estimation, we get the maximum aposteriori estimate x as: 

X = (Si + Sd)“^SpX£) (5.32) 

v/here the measurement vector Xd is given by xd = f7+(w£, - w). 

As in the 2-dimensional case, in 3-dimension also, tracking has been implemented 
using Kalman Filter algorithm. 
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Chapter 6 

Implementation and Results 

6.1 Introduction 

In this chapter, the algorithms for 2-D and 3-D fitting and tracking are given along 
with the results. The implementation has been done in C and the images used were 
of Bit Map Image format (.bmp). Some of the images used are real images while 
some are synthetic. The 3-D visualization has been done using OpenGL. 

6.2 Algorithm for 2-D Curve fitting and Tracking 

1. The image sequence is read i.e. intensity values of all the pixels of all the 
images are stored. 

2. A hand drawn prior is provided around the object of interest in the first image. 

3. The X and y co-ordinates of the points on the hand drawn prior are found out 
and stored. 

4. The wavelet decomposition (wavelet series expansion) is performed on the 
above x-function and ^/-function separately i.e. the wavelet coefficient vec- 
tors w® and are computed. Here Haar wavelets have been used for the 
implementation. Then the combined wavelet vector is formed, which is given 
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by 



5. The shape space matrix H is formed using these w® and values for the 
2-dimensional case. Here Planar Affine shape space has been used. Also the 
pseudo-inverse of H, i.e. 7?+ is found out. 

6. From the hand drawn prior, the edge of the object of interest in the first image 
is measured. For each point on the prior, radially inwards and radially outwards 
a certain number of pixels (say 15 or 20) are chosen and their intensity values 
are stored. Then the gradient information is used to detect the probable edge 
of the object since at the edge there will be a significant change in the intensity 
values. The x and y co-ordinates of these measured points are stored. 



Figure 6.1: Hand drawn prior around the heart. Arrows show the direction of search- 
ing from the hand drawn prior 


7. The wavelet coefficients i.e. w/j® and W£)^ of the measured x and y func- 
tions are calculated. Here also Haar wavelets have been used for the wavelet 
decomposition. Then the combined measured wavelet vector is computed. 

/ Wi," 

W£) = 

\ 

8. The variance ctd'^ of — w is computed. 
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9. The covaiiande matrix Sjj of xd is computed where ^ is given by : 

S£)~^ = (6.3) 

10. The covariance matrix of x is calculated as: 

S,-' = (6.4) 

11. The shape space vector xd for the measured wavelet vector is computed 
using the following relation: 

xp = - w) (6.5) 

12. The value of the variable image number is set to 1 (i.e. for the first image) 

13. If image- number = 1, the maximum aposteriori estimate of the fitted shape 
space vector x is : 

X = (Sx + Sp) ^SpXp ‘ (6-6) 

else the aposteriori estimate of the fitted shape space vector is computed from 
the Kalman Filter algorithm. 

14. The combined wavelet vector w corresponding to the fitted shape space vector 
is computed using the following relation : 

/ \ 

w = Hx + w where w = (6.7) 

from which w® and are found out. 

15. The X and y functions of the fitted curve is constructed by taking the inverse 
wavelet transform of and w*' respectively. 

16. The value of image number is incremented by 1. If image number is less than 
or equal to the total number of images, then the algorithm returns to step 13. 
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6.3 Algorithm for 3-D Curve fitting and Tracking 

1. The image sequence (all the slices of all the images) is read i.e. the intensity- 
values of all the pixels of aU the images are stored. 

2. Hand dra-wn priors are provided around the object of interest for all the slices 
of the first image. 

3. The x, y and z co-ordinates of the points on all the hand drawn priors are 
found out and stored. 


4. The X co-ordinates of all the slices of the first image are arranged sequentially 
in a single array. The same procedure is followed for the y and z co-ordinates. 


5. The wavelet decomposition (wavelet series expansion) is performed on the 
above aj-function, y-function and z-function calculated in the previous step 
separately i.e. the wavelet coefficient vectors and are computed. 

Here Haar wavelets have been used for the implementation. Then the combined 
wavelet vector is formed as follows 


w = 


/ w' \ 

VwV 


( 6 . 8 ) 


6. The shape space matrix H is formed by tahing these w®, and -values. 
Here the 3-dimensional extension of the Planar Afiine shape space has been 
used. Also the pseudo-inverse of H, i.e. is computed. 


7. From the hand drawn priors, the edges of the object of interest for all the 
slices in the first image are measured. For each point on the priors, radially 
inwards and radially outwards a certain number of pixels (say 15 or 20) are 
chosen and their intensity values are stored. Then the gradient information is 
used to detect the probable edges of the object since at the edge there will be a 
significant change in the intensity values. The x, y and z co-ordinates of these 
measured points are stored. 
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8. The wavelet coefficients i.e. Wp®, and of the measured x, y and z 
functions are calculated. Here also Haar wavelets have been used for the wavelet 
decomposition. Then the combined measured wavelet vector is computed. 

( wo* \ 


VfD = 




\ / 


(6.9) 


9. The variance of w^i - w is computed. 


10. The covariance matrix So is computed where is given by: 

Sd~^ = ( 6 . 10 ) 

11. The covariance matrix of x is calculated as: 

(6.11) 


12. The shape space vector X£) for the measured wavelet vector wx) is computed 
using the following relation: 

xp = - w) (6.12) 


13. The value of the variable image number is set to 1 (i.e. for the first image) 

14. If image number = 1, the maximum aposteriori estimate of the fitted shape 
space vector x is: 

x = (S, + Sz>)-'Sx,xx, (6.13) 

else the aposteriori estimate of the fitted shape space vector is computed from 
the Kalman Filter algorithm. 


15. The combined wavelet vector w corresponding to the fitted shape space vector 
is computed using the following relation : 


w = fix -(- w where 


w = 


■wy 

V / 


(6.14) 


from which w®, w^' and are found out. 
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16. The reconstructed x, y and z functions is computed by taking the inverse 
wavelet transform of w®, and respectively. This is actually the co- 
ordinates of all the slices of the image. So the x, y and 2 : functions of the 
diflPerent slices are then separated out. 

17. The value of image number is incremented by 1. If image number is less than 
or equal to the total number of images, then the algorithm returns to step 14. 
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6.4 Simulation Results For 2-D Fitting 



Figure 6.2: (a) Noisy synthetic image, (b) Hand drawn prior provided aroun 
ohject of interest, (c) Me^urement data obtmned from the noisy image, (d) Fitted 

curve around the object of interest 
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<'=> (d) 


Figure 6.3: (a) Real image of a table tennis ball, (b) Hand drawn prior provided 
around the ball, (c) Measurement data (d) Fitted curve 



(c) ■ (d) 


Figure 6.4: (a) Image of a human heart, (b) Hand drawn prior provided around the 
heart, (c) Measurement data (d) Fitted curve 
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6.5 Simulation Results For 2-D Tracking 



Figure 6.5: Rowwise from top : Some Frames from the tracking results in a noisy 
synthetic image 



Figure 6.6: Rowwise from top : Some Frames from the tracking results of a table 
tennis ball in a real image 
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6.6 Simulation Results For 3-D Fitting 



Figure 6.7: 3-D fitting results on MRI slices of human brain 


I 
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Figure 6.8: 3-D fitting results on MRI slices of human brain: contd. 
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Figure 6.9: (a) Hand drawn prior for slice 1, (b) Hand drawn prior for slice 5, (c) 
Measurement for slice 1, (d) Measurement for slice 5 
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Figure 6.10: 3D rendering for the fitted MRI data 



(c) 

Figure 6.11: (a) 3D rendering of synthetic 3-D data, (b) Slice data for the above 
images with the fitted data shown as wire frame, (c) 3D rendering of fitted data 



6.7 Simulation Results For 3-D Tracking 



(>■ 12: 2 frames from the 3D synthetic image used for tracking 



Figure 6.13: Tracked movement of the individual slices 
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Chapter 7 

Conclusion and Future Scope 

Th(? thesis concentrates on fitting and tracking algorithms in 2-dimensions and 3- 
(Unumsions using wavelets. The inter-relation between wavelets and function spaces 
uauudy Sobolev space has been utili25ed to enforce a degree of smoothness to the 
fitted curves. The contour fitting has been done using Bayesian estimation. In the 
thesis Haar wavelets have been used for the wavelet decomposition of the image 
edges. The algorithms developed for both 2-D and 3-D have shown satisfactory 
results. Specially in the 3-D case the fitting has been done on slice data and also the 
3-D rendering has been done using OpenGL for proper visualization purpose. The 
rendering algorithm also shows quite good results. This fitting algorithm is the initial 
step for developing the tracking algorithm. Tracking has been performed for both 
2-dimcnsional and 3-dimensional data. For the tracking purpose Kalman filter has 
been used. The tracking results are also satisfactory as is evident from the examples 
of the previous chapter. As the 3-D visualization of 3-D tracking is quite complicated 
only the movement of the individual slices have been shown. The results make it 
evident that this framework which combines the wavelets and the function spaces 
can lx; used for both tracking and fitting purposes successfully. Some of the practical 
applications can be in medical imaging or tracking of an object in real images. In 
rccciiit, titruis use of 3-D data for medical imaging is quite popular. So this algorithm 
can b(! definitely be used for analyzing such data, like the movements of the human 
luiart can be tracked using this algorithm. 
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7.1 Future Scope 

Some of the directions of future research may include: 

• In this research work Haar wavelets have been used for implementation. How- 
ever proper choice of wavelets is very important for proper fitting and tracking, 
depending on the application. Hence the algorithm should be tested using other 
wavok'ts also. 

• For tracking a proper dynamic model is required for successful tracking of the 
object of interest. The dynamic model should reflect the possible movements of 
the object.. Some frames showing the moving object can be used for extracting 
tins information and can be incorporated in the tracking algorithm. 

• Simple Kalman filter has been used for implementing the tracking algorithm. 
But for images containing more clutter this algorithm may not be a robust one. 
For more robust and accurate results extended Kalman filter or condensation 
algorithm can be used. 

• Here planar aflSne shape space has been used for representing the deformation 
of the object. However other shape spaces which can represent the deformation 
in a better way can be used. 
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